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Abstract 

We consider a non-homogeneous nonlinear stochastic difference equa- 
tion 

X n+1 = X n (l + f(X n )Z n+1 ) +S n , n = 0, 1, . . . , 

> : v ' 

and its linear counterpart 

CO' X n + 1 =X n (l +£n + l) +S n , 71 = 0,1, 

00 . 

■ both with initial value Xo, non-random decaying free coefficient S n and 

independent random variables £ n . We establish results on a.s. conver- 
gence of solutions X n to zero. Obtained necessary conditions tie together 

■ certain moments of the noise £ n and the rate of decay of Sn- To ascertain 

sharpness of our conditions we discuss some situations when X n diverges. 

S We also establish a result concerning the rate of decay of X n to zero. 
Several examples are given to illustrate the ideas of the paper. 
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1 Introduction 

The theory of stochastic difference equations is relatively young, especially in its 
nonlinear part. Linear stochastic difference equations with independent iden- 
tically distributed perturbations (i.i.d.) are the most studied ones (cf [§]) but 
even for this type of equation there still exist some open questions [201 • I n this 
paper we are going to give answers to some of them and then proceed to discuss 
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a class of nonlinear stochastic difference equations for which very few results are 
available Ql U3 El EH EH E3 

The interest towards stochastic difference equations has been on the increase 
due to their numerous applications and the fact that they serve for numerical 
simulations of stochastic differential equations (cf 0181^2 ED- Stability of 
solutions of stochastic difference equations is also very important in, to give 
some examples, mathematical finance (asset price evolution in discrete (B, S)- 
markets) and mathematical biology (population dynamics), see, for example, [H] 
and references therein. 

The main objects of our consideration are the following equations: the non- 
homogeneous nonlinear stochastic difference equation 

X n+1 =X n (l + f(X n )U+i)+S n , neN = NU{0}, (1) 

and its linear counterpart 

X n +i = X 

II 

with initial value Xq > 0, non-random free coefficient S n and independent 
random variables . Unless explicitly indicated, we do not demand that be 
identically distributed. Everywhere in the paper we suppose that 

/ : M 1 — > [0, 1] is continuous and f(u) = Q -O- u = 0, (3) 
1 + £n+l > and S n > Vn G N . 

These conditions guarantee that X n remains positive for all n. 

Equations of the type Q and ijSJ) are sufficiently complex to require more 
powerful methods than those used to study, for example, the linear homogenous 
equation 

X n+1 = X n (l + £„+i), neN . (4) 

On the other hand, equations and © are sufficiently simple to allow a rather 
complete understanding of their behaviour. In our paper we use an adaptation 
of a martingale convergence theorem to prove most of the results. The methods 
of proof that we develop can also be used on more complicated recursions or 
in more applied contexts, for example to study the faithfulness properties 1 of 
numerical solutions to stochastic differential equations. 

To get the flavour of our results it is instructive to start with the behaviour 
of the corresponding deterministic equation, 

Xn+1 = X n (l + a n+ i^j + S n , 

with 1 + a„+i > (the nonlinear deterministic equation is discussed in Sec- 
tion l6.1|) . If a n = a, the solutions converge to zero when a < (or ln(l + a) < 0, 
which is the same) and S n — > 0. 

1 such as the A-stability, which was studied in |7| on the example of the recursion of the 
type A method is said to be A-stable if it correctly predicts the asymptotic stability of 
the approximated equation. 
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Now take S n = and allow a n to contain noise, a„ = a + £„ with E£„ = 0. It 
is easy to see that the solutions will still tend to zero if a = E(a + ( n ) < 0. But 
they will also tend to zero if a > but Eln(l + a + ( n ) < 0, which is a weaker 
condition. We will refer to this phenomenon as the "stabilisation by noise" : the 
solution of x n+ i = x n (l+a) with a > can be stabilised by adding some noise 
to a (for an in-depth discussion of stabilisation by noise see e.g. [Tl 151 151 IT5)V 
A natural question arises: when the noise is present, how fast must S n decay 
to guarantee that the convergence persists? Would S n — * be enough? We 
will discuss this question at length in the present paper but the short answer 
is the following. The coefficients S n must have a power law decay, with the 
exponent determined by the nature of the noise. Thus, the addition of the noise 
stabilises the homogenous linear equation but imposes stronger conditions on 
the free coefficient S n of the non-homogenous one. It is interesting to compare 
our results with those available in the continuous case, where the interplay of 
the noise and the rate of decay of the free coefficient was studied in 0. 

In nonlinear case Q, however, the noise does not have such stabilising effect. 
Our stability result (if restricted to i.i.d. noises) includes only the case E£„ < 0. 
We investigate the case E£„ > further and show, for bounded i.i.d. £„, that 
linin—Kjo X n = with probability zero. Hcuristically, the noise does not have 
the stabilising effect on the nonlinear equation because the coefficient by £ n 
becomes too small if X n — ► (see condition ©). The situation changes when 
instead of equation (JIJ we consider a discrete version of Ito stochastic equation 
with the drift and diffusion parts separated and multiplied by coefficients with 
different scaling: 

X n+1 = (1 + kf{X n )a + y/kf(X n )( n+1 )X n + S n , n g N . (5) 

In this case we give a sufficient conditions for lirrin—^oo X n = a.s. even when a 
is positive (but not too large). 

The structure of the paper is as follows. In sectional we give some necessary 
definitions and state two lemmas. Lemma^can be considered a discrete version 
of martingale convergence theorem and is the main tool we use to prove our 
results. Section |2| is devoted to the a.s. convergence to zero of solutions to the 
linear equations with independent noises. We also present a result on the rate 
of decay of the solutions. Section 0] is devoted to a discussion of the obtained 
results as they apply to the i.i.d. noise. Further results in this simple case 
highlight some aspects of behaviour of the solutions. In particular, we construct 
some examples that indicate that our conditions for the a.s. convergence might 
be necessary as well as sufficient. We also find that when the decay of S n is 
insufficient to guarantee convergence but E ln(l +£ n ) is negative, the lower limit 
of the solution is still zero. This implies that, in some cases, the solution will 
oscillate with increasing amplitude. 

Section is devoted to nonlinear equation Q . Sufficient conditions which 
guarantee that lim JWOO X n = are given in the case when S n are summable and 
when are summable with some a < 1. We also prove, for bounded i.i.d. £ n 
with E£„ > 0, that linin^oo X n — with probability zero. Then we consider 
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equation J3J), a discrete version of Ito stochastic equation, and give a sufficient 
conditions for the a.s. convergence of the solutions to zero. 

We illustrate our results with examples and defer all proofs to the last section 
of the paper. 



2 Auxiliary Definitions and Facts 

Let (O, J 2 ', {J-"„} n gN, P) be a complete filtered probability space. Let be a 

sequence of independent random variables. We suppose that filtration {^-"njneN 
is naturally generated: J- n +i = : i < n}. Among all sequences {X„}„ e N 

of random variables we distinguish those for which X n are .^-measurable Vn £ 
N. 

We use the standard abbreviation "a.s." for the wordings "almost sure" or 
"almost surely" with respect to the fixed probability measure P throughout the 
text. 

A stochastic sequence {X n } ne ^ is said to be an T n -martingale, if E|X„| < oo 
and E(X n |^ r n _i) = X n _i a.s. for all n 6 N. A stochastic sequence {/i n }neN 
is said to be an T n -martingale- difference, if E|/x n | < oo and E(/i„|jF„_i) = 
a.s. for all n 6 N. 

For more details on stochastic concepts and notation we refer the reader to 

[HI EU EH [H] 

Below is a version of a martingale convergence theorem, which is convenient 
for many proofs. 

Lemma 1. Let {Z n } ne iq be a non-negative T n -measurable process, E|Z n | < oo 
Vn e N and 

Z n +i < Z n + u n - v n + v n+ i, n S N, 

where {f n }neN « s T n -martingale- difference, {u n } ne fij, {u„} n£ N ar e nonnegative 
T n -measurable processes, E|u„| and E|u n | are finite. 
Then 



jw : ^ju„ < oo | C jw : i>„ < oo j f^\{Z ->}. 
Here {Z — >} denotes the set of all u> £ f2 for which Z^ = lim Z n exists and 

n — >oo 

is finite. 

We will also use the following elementary estimate. 

Lemma 2. For any a > 1 £/iere exists a function K continuous on (0, oo) such 
that for any a > and b > 

(a + 6) Q < (f + e)a Q + X(e)6 Q , 

where K(e) can be estimated in the following way: 

K{e) < 1 + A"i(a)e 1 "". 
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We define [u] + and [u] to be the positive and negative parts of u corre- 
spondingly, 

u, if u > 0, r _ J u, if u < 0, 

0, otherwise, [0, otherwise. 

We will say that a sequence {S n } is a-summable if 

oo 

E S n < OO- 

n=l 

3 Linear non-homogeneous equation with inde- 
pendent noises. 

Below is our main result on the limit of solutions to linear equation @ ■ The con- 
ditions for a.s. existence of a limit depend on the balance between a-summability 
of S n and the signs of E(l + &+i) Q - 1. 

Theorem 1. Let X n be a solution to equation 0). If there exists a > such 
that 

oo 

E[E(i+&+ir-i] + <^, (6) 



and 



£S?<oo, if a<l, (7) 



i=l 



oo ^ a 

^ |i-E(i + e i+ i) a | 

£/jen lim n ^oo -^n exists. If, in addition, 

oo 

^\E(1 + M a -1]~ =-oo, (9) 

i/ien limn^oo X n = 0. 

Remark 1. If are independent and identically distributed (i.i.d.), as opposed 
to just independent, then E(l + £ n +i) a — 1 does not depend on n. Therefore 
conditions © and are fulfilled whenever E(l + £ n +i) a — 1 < for the 
corresponding value of a. 

We note that if /? < a then E(l + £„+i)" - 1 < implies E(l + £, l+ i) /3 - 1 < 
0. Thus the requirements on £ get stronger with the growth of a. This is 
compensated by weakening of the requirements on S n (in the i.i.d. case condition 
(JS) is just the a-summability of S„). 

Interestingly, when a < 1 one can have E£„ > 0. This will be discussed in 
more detail in Section below. 
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The following example illustrates the case when Si — oo and a > 1. 

Example 1. Let 



—?i a 
v/n 



with probability 1 ^, 

1 

with probability -7, 



and 



Then 



Et; n =n-3 1- — 
77/ 



/n— ~ -77 3 , 

77/ 



and 



Therefore, 



= -n s i__ +„_~„ 3 



1 - E(l + 60 2 = -2E£„ - E^ ~ 2n- 3 . 

Even though S n are not summable, conditions © and JSJ) are fulfilled with 
a = 2, since 

00 00 

^[E(l+e„+l) 2 -l]^-2^77-3 =-00, 



n=l 



Q2 

\ "* 

, l-E(l+Cn+l) 2 
n— 1 n— 1 

Then Theorem ^ implies that lim^^^ X n = a.s 



1 _ 6 _z 

77 3 77 4 = / 77 6< OO. 
n=l 



The next result gives the rate of decay of solutions to equation J2J) when we 
impose more restriction on the summability of the free coefficient S n . 

Theorem 2. Let be independent random variables and X n be a solution to 
equation 0). If for some a G (0, 1] there are Ki such that 



> [E(i + e 1+ i) Q -1] 



(10) 



-co, 



i=l 

00 



then for every 7 € (0, 1) 



(11) 



lim e -^r=,«iy« = 0. 
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4 Discussion of Theorem [T] 



In this section we limit ourselves to considering i.i.d. £„. We discuss two ques- 
tions here, the sharpness of the conditions of Theorem^and using E In (l+£i) < 
as an indicator of a.s. convergence. 

4.1 Is a-summability necessary? 

The following lemma shows that in general one can not relax the condition of 
a-summability of S n . 

Lemma 3. For any a and (3 satisfying < a < [3 there exist i.i.d. random 
variables {£ n }jJLi an d perturbations S n such that 

E(l+O a = l, (12) 

oo 

(13) 

n=l 

and yet the solution X n of equation @) is diverging in the sense that 

limsupX„ =oo a.s. 

n — >oc 

Remark 2. Theorem ^ requires a > (3 to guarantee a.s. convergence of X n . 

4.2 Homogeneous equation 

When equation © is homogeneous (i.e. S n = 0), the limit is zero if and only if 
Eln (l + &) < (see, for example, [IB] or |20]1: 

Theorem 3. Assume that {(„} n gN o,re i.i.d. random variables and X n is the 
solution of equation with S n = 0. Then lim„^ +00 X n = a.s. if and only if 
Eln (1 + &) < 0. 

It seems, therefore, that Eln (l + £A < is a natural indicator of the con- 
vergence of X n . Sections 14 . 31 and WM develop this observation. 

4.3 Lower limit 

When Eln (l + &) < and S n is non-zero but decreases exponentially with n, 
it was proved in [201 that lim JW+00 X n = 0. When S n does not decrease as 
rapidly, it turns out that condition Eln (l + £j) < guarantees that the lower 
limit of X n is equal to zero. 

Theorem 4. Let £„ be i.i.d. with Eln(l + £„+i) < 0. If there exists a > such 
that YliLi < oo, then 

hminfX n = a.s. 

n — >oo 

Remark 3. In some cases, in particular those covered by Lemma the lower 
limit is equal to zero while the limit does not exist. An interesting question is 
the existence of the limiting distribution of X n in such cases. 
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4.4 Connection between Eln(l + &) and E(l + — 1. 

Theorem |3 indicates that the sign of Eln(l + £j) is crucial in the question 
of stability of homogenous equation with i.i.d. noises. Theorem ^ however, 
depends on the sign of E(l + — 1 to establish stability. The following 
lemma provides the connection between the two expectations. 

Lemma 4. Let £ be such that P(£ > 0) > 0. Then Eln(l +£) < if and only 
if there exists a > such that E(l + £) Q — 1 = 0. // suc/i a exists then 

E(l + {f-l<0 V/3€(0,a). (14) 

Proof. The harder "only if" part was proved in [S], using that E(l + £) Q is a 
convex function and its derivative at a = is equal to Eln(l + £). Convexity 
also implies inequality ((Till . 

To prove the "if" part we take expectation of the both parts of the inequality 
(1 + £)" > 1 + u ln(l + £) which can be obtained by truncating the Taylor series 
of (1 + £)" with respect to u. □ 

When £„ are not identically distributed, one needs a uniform bound on a. 
Such a bound is provided by the following lemma. 

Lemma 5. Suppose that there exists some constant K > such that 

E [(2 + &) In 2 (1+& 



<if, VieN. (15) 



|Eln(l + &)l 

Then for all a satisfying 

a < min (1/K, 1) 

one has 

aEln(l + &) < E(l + g,) a - 1 < a ^Eln(l + 6) + Bl±j*U ^ . (l 6 ) 

Example 2. Suppose that —1 < —k<£ n < L and |Eln(l + £„)| > c for some 
k, L, c > uniformly in n G N. Then condition (|15l) is fulfilled. 

4.5 Reformulation of Theorem [T] in the i.i.d. case 

Following the discussion of the previous sections we can reformulate Theorem^ 
in this concise way. 

Corollary 1. Let £ n be i.i.d. random variables satisfying 

E(l + £n) Q - 1 < 

for some a > 0. If S n are a-summable then the solutions of 
X n+1 = X n (l + ^ n+ iJ + S n , ne N , 
converge to zero a.s. 
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Proof. The only part of the statement that does not obviously follow from The- 
orem ^ is what happens when E(l + £ rl ) a — 1 = 0. In this case Theorem ^ 
guarantees only the existence of a limit. Here, however, we employ Lemma|3]to 
infer that Eln(l + £„) < 0. Then we use Theorem 0] to confirm that the limit 
must indeed be zero. □ 

On the other hand, LemmaElhints that a-summability is not only a sufficient 
but also a necessary condition. We formulate this guess as a conjecture. 

Conjecture 1. Let^ n be i.i.d. random variables satisfying Eln(l + £„) < and 

let a > be such that 

E(l+£ n ) Q -l = 0. 

Then the solutions of 

X n+1 = X n (l + +S n , ne No 

a.s. converge to zero if and only if S n is a-summable. 

Another interesting question would be to study the convergence of X n to 
zero in probability. For this type convergence, it might be possible to relax the 
conditions on the decay of S n . Previous results by various authors ^3 IT7| 
should be helpful in this direction. 



5 Nonlinear equation 

In this section we consider nonlinear recursion of the type 

X n+X = X n (l + /(X„K„+i) + S n , n e No (17) 

with independent random variables £„. As mentioned earlier we assume that 
the function f(u) is continuous with values in the interval [0, 1] and is equal to 
only at u — 0. We also assume that both terms in equation l|17|l are non-negative 
for all n. 

5.1 Convergence results for nonlinear equation with inde- 
pendent noises 

Only the a = case of Theorem ^ really carries over to the nonlinear equations 
of type (|T7j> . 

Theorem 5. // the components of eguation jJ7| ) satisfy the conditions detailed 
above, S n are summable and 

oo 
n=l 
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then lim n _ ) . 0o X n exists. If, in addition, 

oo 

]r m n ]- = -oo, (19) 

n=l 

then limn^oo X n = 0. 

In the case when S n are a-summable for some a € (0, 1) we obtain a much 
more restrictive result compared with Theorem^ Even the case of i.i.d. noises 
with positive E£„ is not covered by this theorem. We will explore the reason 
for this in the next section. 

Theorem 6. Let S n be a-summable for some a £ (0, 1), 

oo 

^[E£ n ]+<oc, (20) 

n=l 

then linin^oo X n exists. If, in addition, SE^ — (2 — a)[E£ J 3 J + > starting with 
some n and 

f^E^-^[Ea + )=-, (21) 

then linin^oo X n = 0. 

The following example shows that in the case when S" are summable with 
some a < 1, Theorem [S] gives less restrictive conditions than Theorem [3] 

Example 3. Let be uniformly distributed on the interval [— l+?i~ 2 , 1]. Then 

E£„cxn~ 2 , a 1 and oc nf 2 . 

Thus conditions (|2UJ| and (|2U are fulfilled for all a € (0, 1), but condition ifH?)l 
is not. 

5.2 Divergence in nonlinear equation with E£j > 

In this subsection we present a result explaining why one cannot fully generalise 
Theorem n to nonlinear equations of the type i|17|) . 

Theorem 7. Let X n be a solution of equation |J7| ) with i.i.d. satisfying 

E£„ > and - 1 < -k < < L, n e N. 
Then P{X n -> 0} = 0. 

However, if, instead of equation (|17|l we consider a discrete analogue of Ito 
equation, the situation is reversed and we obtain a convergence result when 
is summable with some a > 0. 
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5.3 Analogue of Ito equation 

We consider the discrete analogue of Ito equation 



X n+1 = (1 + kf(X n )a + y/kf(X n )( n+1 )X n + S n , X > 0, (22) 

where a > 0, ( n are i.i.d., EC„ = 0, E£ 2 < oo and E|£„| 3 < oo. 

We assume, as everywhere before, that for all positive u and all n 



1 + kf(u)a + y/kf(u)Cn+i > and S» > 0. (23) 

Theorem 8. Let conditions (0) and \23p be fulfilled. Let also 

EC 2 
a< — ■ 

Suppose S n are a-summable for some a satisfying the inequality 



EC 2 - 2a 

a<a °= EC 2 ■ ( 24 ) 



Then, for small enough k, ¥{X n — > 0} = 1. 

Remark 4. We can treat equation ll'L'l) as an equation with noise £ „ = a + ( n 
where a = E£ n . From this point of view equation (|22|l is a modification of 
equation (|17fl . in which the coefficients of the two parts of the noise, drift and 
diffusion, are different. Since a > 0, the corresponding deterministic equation, 

x n+ i = (1 + kf(x n )a)x n + S n , 



is unstable. The diffusion part, ^Jkf{x n )C,n+i, stabilises the equation. It be- 
comes possible because the coefficient of the diffusion part, y / kf(x n ), decreases 
slower then the coefficient of the drift part. 

It is worth noting that equations (1221) and l|17|) coincide only when a = 0. 

6 Proofs 

6.1 Deterministic lemma 

For the purposes of comparison with equation we discuss here a stability 
result for the deterministic equation 

(1 + f(x n )a„) + S n , x > 0, n € N . 

Lemma 6. Let S n > 0, f : R 1 ^ [0, 1], /(0) = and M u>c uf(u) > Vc> 0. 
Let also > a n > —1 and X)^°=i a n — —oo. 
//limn^oo S n /a n = 0, then lim^oo x n = 0. 
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Proof. We note that the solution x n remains positive for all n. We consider two 
possibilities: liminf x n > and liminf x n = 0. 

In the first case there exist c > and N such that x n > c for all n > N. Let 
ci = inf u>c {/(u)u} and Ni > N be such that S n < C1 >® n ' for n > N\. We have 
for n > Ni 

n n 

x n+1 = x Nl + 2J [Kj/(xi)oj + 5 4 ] < x^+ci 

i=JVi i=iVi 

When n — > oo the right-hand-side of the inequality tends to — oo, which contra- 
dicts the positivity of the solution. Thus liminf x n = 0. 

Now assume that, even though liminf x n = 0, the lemma is still incorrect, 
i.e. limsup,^^ x n — c > 0. We fix some e < c/2 and define 

< £i = inf {/(«)«}. 

s<u<2e 

Now find iV such that 5„ < ei|o n |/2 and S n < e whenever n> N. 

li x n < e (which must happen infinitely often) with n > N, we can estimate 

2^1+1 5: + S n < 2£. 

If, on the other hand, e < x n < 2e then, by definition of £i, x n f(x n ) > £i and 
therefore 

x„+i = x„(l + f(x n )a n ) + S n < x n - si\a n \ + y|a„| < i„. 

Combining the above two facts we deduce that, once x n gets below e, it cannot 
increase past 2e. Thus lim sup„_^ oc x n < 2e < c and we arrive to a contradiction. 

□ 

6.2 Proof of Theorem [l] 

We split the proof into two parts: a £ (0, 1] and a > 1. 

6.2.1 Proof of Theorem [T] with a £ (0, 1] 

We note that Pi+i, defined by 

p l+1 = X?(l + - X? E(l + e i+ i) Q (25) 

is an J^j+i-martingale-difference. 

We apply Holder inequality (x + y) a < x a + y a to equation (0) and get 

X"+l < (1 + Cn+l) Q + 

= ^ + x°(e(i + e„+i) Q - 1) + [xf (i + - e(i + e„+i)1 + s; 

= X" + X a n (E(l + e„+l) Q - 1) + S% + Pn+l 
< X% + X% [E(l + £ n+ i) Q - 1] + + 5" + p„+i 



a > + — < x Nl -ci —■ 
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with p n +i defined in equation (|25[l . We let 

Yn = e -E? =1 ^x£, with % = [E(l + i 1+1 ) a - 1] + , 
and using the above, arrive at 

Y n+1 Y n = e- S ri 1 * (Jf « +1 - X «) + X»e" £ * (l - e^ 1 ) 

< e - ES 1 « (X> n+1 + p n+1 + S%) - jfc+iX-e-Sri 1 w 
— e Pn+l T e O n — Pn+l t o n . 

Since p n +i is an .F„+i-martingale-difference and 53i=i S* < oo by a combi- 
nation of conditions J§} and (JJJ , we can apply Lemma ^ Therefore Y n — 
exp{— y^ t _ 1 r]i}X" converges as n — > oo. From condition JBJ we infer that X" 
also a.s. converges to a finite limit. 

To prove that lirriji^oo X n =0we apply Lemma ^ to the inequality 

x: +1 <x%+ x% [e(i + e, l+ i) Q - 1] _ + x« [e(i + - 1] + + s° + Pn+1 , 

where 

^[E(i + e i+ i) Q -i] + xr 

i=0 

converges a.s. due to condition © and the convergence of X". From LemmaQ] 
we infer that 

oo 

-£[E(1 + &,+!)" -l]~Xf 

has to be a.s. finite. Combining it with condition J3J we conclude that X" — * 
a.s. 

6.2.2 Proof of Theorem [T] with a > 1 

Let 

_ |i-E(i+e„+i) a i 

2E(l + £ n+1 )° ' ( ' 

Applying Lemma [5] we get 

X: +1 < (1 + e n )X% (l + e, i+ i) Q + K(en)SZ, (27) 
where K(e n ) can be estimated by the following 

K(e n ) < 1 + K(c04~ Q = 1 + K(a) ( 2E (! + 

< 1 + K(a) r < — T . 

]i - e(i + e»+i) < *r _1 ~ ii-Eci+^+^r 1 ' 
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where we used that E(l + 6-1+1 ) Q is bounded due to condition JBJ. From equa- 
tions (GUJl- (27J we get 



x% +l <x« + x: [(i + £ „)e(i + c„ +1 ) q -i 

+ x«(i + e „) [(i + e„+i) Q -E(i + e„+i 



By substituting the value of e n into (1 + e„)E (1 + 6t+i)" — 1 we see that it is 
equal to [E (1 + £ n+ i) a - 1] /2 when E (1 + 6 l+ i) Q < 1 and to 3 [E (1 + £ n+1 ) Q - 
otherwise. That is, we can write 



(i+e„)E(i+e„+i) a -i = i 

We finally arrive to 



E 1 + 6 



n+1 



- 1 



El 1 + -1 



Pn+1 



E !+£„+! 



#i(a) 



(l-E(l+en+l) Q ) Q 



QOt 



E l + £„+i 



where p n +i is an .F n +i-martingale-difference. Now we apply Lemma ^ an d 
complete the proof as in Section IS. 2. II 

6.3 Proof of Theorem H 

We mimic the proof of Theorem (see Section T6. 2. Ill with Y n = e~^?=i 
to get 

Y n+1 - Y n < p n+1 + e-Sri 1 «sj. 

Because p~n+i is an J^+i-martingale-difference and due to condition 1)11)0. we 
can apply LemmaQ] Hence we get that Y n = exp{— Y^i=i K i}-^n converges to 
a hnitc limit as n — > oo. Then for every 7 6 (0, 1) 

cxp|-7^ l |^<y n exp|(l- 7 )^ Kl | ->0 (28) 

using condition (|11|) . 

6.4 Proof of Lemma |31 

We choose 7 such that a < 7 < f3 and take S n — rT^I 1 so that condition l|13f) 
is clearly satisfied. Now define the distribution of £„ so that 1 + takes values 
in (a, 00), a > 0, with the density function 



p(x) 



7a ' 
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First we ascertain that E(l + £) a = 1. Indeed, since a < 7, 



poo 

E(l+£)" =7« 7 / x^-^dx 



7 



7 



and condition 1|12|) can be satisfied with an appropriate choice of a. 

Now we can study the behaviour of solutions of equation J3J). Since both 
summands in the right hand side of equation J5J) are positive, X n+ \ > S n and 
therefore X n+ 2 > (1 + £, n +2)S n . Define the sequence of independent events 
A n = {(1 + £, n +2)S n > C}, where C > is an arbitrary constant. We have 



\A n ) = P ( (1 + £ n+2 ) > £l) = P ((1 + £ n+2 ) > Cn 1 ^) = ^n- 1 



Thus, 

OO 



oo, 

n=l 



and, by Borel-Cantelli lemma, events A n must happen infinitely often. There- 
fore, infinitely often X n > C. Since C was arbitrary, we conclude that lim sup^^^ X n 
oo a.s. 



6.5 Proof of Theorem |U 

Assume the contrary, for some s > the event J s = {uj : inf ra X" > s} occurs 
with non-zero probability. Fix e > such that aE ln(l + £) + ln(l + e) < and 
consider the event = {uj: Ya=i ^ n ((l + e )(l+£») a ) ~~ ¥ — oo}. By applying the 
law of large numbers it is straightforward to show that occurs with probability 
1. 

Raising recursion (J2J) to power a we get by Lemma [21 

< (l + e)JC(l+£„ + i) Q + K(e)S%. (29) 

Now let n be such that K(e)S" < s/2. Restricting our attention to u> G J s we 
apply logarithm to both sides of inequality Q29Jl and use the inequality 

y 

ln(x + y) < ln(x) H — 

x 

to obtain 

Combining inequality (|29|l and the definition of J s we can estimate X"(l + 
e)(l + £„+i) Q > X% +1 - K{e)S% > s/2 and, therefore, 

In < ln(X«) + ln ((1 + e )(l + C„+i) Q ) + K(e)^. 
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Applying the above inequality recursively we obtain 

k k-l 

lnX« +fe < ln(A^) + In ((1 + «0(1 + + C ]T 

i=l i=0 

where C = 2K(e)/s. Since X" +fc > s and S" are summable to, say, 5, we 
conclude that for all k 

k 

and, therefore, the event a; cannot belong to 0. Thus J s n O = which is a 
contradiction. 

6.6 Proof of Lemma [U 

Taking the expectation of the Taylor expansion of (1 +£i) a in terms of a we get 
E(l + &) Q = 1+«E ln(l + &) + o 2 E ( ln2(1 2 +6) (l + CO 9 ) , 

where 6* € [0, a]. The left side of estimate (|16H is then obtained by leaving out 
the third term. 

To estimate E (ln 2 (l + ^)(1 + ^) /2) from above we consider two cases: 
1 + £j > 1 and 1 + < 1. Since 6 < a < 1, in the first case we have (1 + < 
(1 + while in the second (1 + < (1 + = 1. Then, in both cases, we 
have 

(i + £0 e <2 + &. 

If Eln(l + £j) is negative we continue with 



/ E((2 + &)ln 2 (l+&)) ^ 
'V ° 2|Eln(l + eOI J 



E(1+&) Q < l + aEln(l + £ 

< l + aEln(l + fc)fl-ay) < 1 + |Eln(l + 
while if Eln(l + £j) > we obtain by a similar calculation 

E(1+{ , r < 1+<1 2__i_a. 

6.7 Proof of Theorem O 

We note that Pi+i, defined by 

p i+1 = f(Xi)X^ i+1 - f(X i )X i E(£ i+1 ). 
is an Jvi+i-martingale-difference. 
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After rearranging in equation (|17f) we get recursively 

X n +i = X n + f{X n )X n Ei^ n+ i + [f(X n )X n £ n+1 — /(X n )X n E^ n+ i] + S n 
= X n + f(X n )X n [E^„ + i] + + f(X n )X n [E^ n+ i] + p n +i + S n 
<X n + f(X n )X n [EC Ti+l I ~l~ Pn-\-l ~H $n 
< X n + X n [E£ n +i] + + p n +i + S n . 

(30) 

From this point we continue as in Section lt).2.1l with r\% = [E£„ + i] + and conclude 
that Xi converges to a finite limit a.s. Then 

oo 

j2mi+i)} + f(Xi)Xi 

i=0 

is a.s. finite. Applying Lcmnia[I] again (to the second line in inequality (|3L)[l ). 
we conclude that 

oo 

Y / m t +iTf(x l )x l 

also has to be a.s. finite. If condition 119|) is fulfilled, f(Xi)Xi is forced to 
converge to zero. Therefore Xi — > a.s. 

6.8 Proof of Theorem EU 

Applying the inequality 

1 — a , (1 — a)(2 — a) 

(1 + x) a < 1 + ax x 2 + - - -x 3 , x > -1, < a < 1 (31) 

2 6 

2(Y \ -> f3f 



and noting that f\X n ) > f 3 (X n ), we obtain 



E 



X^(l + f(X n )U+ir\^n 



< XI (l + af(X n )E£ n+1 - ^f(X n )E£ +1 + (1 a f a) f 3 (X n )Jt£ +1 



17 



Now, applying inequality (a + b) a < a a + b a to equation l|17fl we get from the 
above 

X"+i < X% 1 1 + f(X n )£ n+ i + S" 



E X%(l + f(X n )£ n+1 ) a \f n 

X£(l + /(X n )£ n+1 ) Q -E 
<X: + aX»f(X n )m n+1 } + 



X«(l + /(X„Kn+i) Q |^ 



QOt 



Now we complete the proof in the same way as in Theorem 

6.9 Proof of Theorem 

For the proof we need some preliminary facts. 

Lemma 7. Let {X n } ra6 N be a sequence of ' T n -measurable random variables such 
that E(X n \j r n ^i) = 1. Let Z n = J]™ = i X, and E\Z n \ < oo for all neN. Then 
{Z n }nefi is a martingale. 

Proof. To check the martingale condition E(Z n | J- n -i) = Z n -\ we use the T n -\- 
measurability of Z n -\'- 



E(Z„|j r n _i) — E(Z„_iX„ J J- n -i) — Z n -{E{X n | T n -\) — Z n -\. 



□ 



Lemma 8. Let X n be a solution of equation |J7| ). Then the sequence {M„} ne N, 
defined by 



m -TT + 

" iJ;E((l + /(X i )6 + l)- 1 |^) 



(32) 



i=0 



is an J 7 ,!- martingale. 

Proof. To make sure that our definition makes sense we estimate 

1 + /(*<)&+! > 1 " 16+1 1 > 1 - fc > 0, 



(33) 



therefore E ((1 + f(X i )£ i+ i)~ 1 \j r i) is well defined. Because M n is always posi- 
tive, we can write E|M n | = EAf„ = EMi = 1 < oo. Now we apply Lemma[7|to 
conclude the proof. □ 

The lemma below is a variant of the theorem of convergence of non-negative 
martingale (see e.g. [H]). 
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Lemma 9. If {X„}„ g jj is non-negative martingale, then Hin^^oo X n exists with 
probability 1. 

From Lemma [H] and Lemma [5] we can get 

Corollary 2. Let {M n } nt =fi be the martingale defined by ijffljj) . then liirin^oo M n 
exists with probability 1. 

Now we proceed to the proof of the theorem. First we note that the solution 
X n of equation (|17[) can be represented in the following form 



1 



L E((l + /(X 4 )6+i)- 1 |^) 



(34) 



Here M n is defined by equation l|32f> and, by Corollary [3 M n < Hi with a.s. 
finite random variable H± — Hi(lo). 

Suppose now that theorem is not correct. Then there exists a set tti C Q 
of non-zero probability such that X n — > a.s. on fii. We aim to show that for 
any u> G f2i, there exists N(lo) such that 



E^(l + /pQ)&+i) |^J<1, Vi>JV(w). 
For Vi 6 N we can perform the Taylor expansion 

(i + fix^+i)- 1 = i - f(x^ i+1 + f 2 (x t )$l + i - fi^fh 

with lying between and f{Xi)^i + i. Using equation and noting that 
X n is positive and 

E(/(Xi)|^) = f(X t ), E(& +1 |^) = E^+i, < fiX,) < 1, 

we estimate 



E 



(i + 0. t+ i) 4 



(l-fco) 4 



Then we have 

e((i + /pq)& +1 ) 



^ < i-/(x 4 )E6 + i + r(^)^ 



= 1 - f(Xi) E£ i+1 - f{Xi)V - 



(i - k y 

(1-fco) 4 



The function / is such that f{X n ) — > a.s. on Oi, therefore we can find such 
7V(w) that for fii and i > N(u) 



E (1 + /(Xi^i+i)-" 



< 1. 



Combining this with representation (|34l) and with a.s. boundedness of M n we 
conclude that solution X n cannot tend to on fif 
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6.10 Proof of Theorem H 

As before, we raise equation H22[) to power a and set 

Pn+i =X%(l + kf(X n )a + v/fc/(X n )Cn+i) a -E [X° (l + kf(X n )a + y/kf(X n )( n+i y\F n 

We now aim to show that the conditional expectation above is negative. Ap- 
plying inequality l|31[l and remembering that E£ n +i = 0, we get 



E 



(l + kf(X n )a + y/kf(X n )C n+1 



3~ I I 



< 1 + akf(X n )a - ((akf(X n )) 2 + fc/(A„)EC 2 ) 

+ Q(1 ~ Q ( j (2 ' a) ((akf(X n )f + 3a(fc/(X„)) 2 EC 2 + (fc/(X„)) 3 / 2 EC 

< 1 + akf(X n ) (a - ^r^EC 2 + 0(Vk) 

Due to condition l|24|l there exist fco and ao, such that for k < fco 

1 - a, 

a 

2 

Therefore we obtain the estimation 



EC 2 + 0{Vk) < -a < 0. 



X^+i < X™ - a X"akf(X n ) + p n+1 + S". 
Now we can apply Lemma Q and complete the proof by the familiar method. 
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